Digital chronofiles of life experience

Technology has brought us to the point where we are able to digitally sample life experience in rich multimedia detail, often referred to as lifelogging. In this paper we explore the potential of lifelogging for the digitisation and archiving of life experience into a longitudinal media archive for an individual. We motivate the historical archive potential for rich digital memories, enabling individuals’ digital footprints to con- tribute to societal memories, and propose a data framework to gather and organise the lifetime of the subject

Experiences of aiding autobiographical memory using the sensecam

Human memory is a dynamic system that makes accessible certain memories of events based on a hierarchy of information, arguably driven by personal significance. Not all events are remembered, but those that are tend to be more psychologically relevant. In contrast, lifelogging is the process of automatically recording aspects of one's life in digital form without loss of information. In this article we share our experiences in designing computer-based solutions to assist people review their visual lifelogs and address this contrast. The technical basis for our work is automatically segmenting visual lifelogs into events, allowing event similarity and event importance to be computed, ideas that are motivated by cognitive science considerations of how human memory works and can be assisted. Our work has been based on visual lifelogs gathered by dozens of people, some of them with collections spanning multiple years. In this review article we summarize a series of studies that have led to the development of a browser that is based on human memory systems and discuss the inherent tension in storing large amounts of data but making the most relevant material the most accessible

User interaction for visual lifelog retrieval in a virtual environment

Efficient retrieval of lifelog information is an ongoing area of research due to the multifaceted nature, and ever increasing size of lifelog datasets. Previous studies have examined lifelog exploration on conventional hardware platforms, but in this paper we describe a novel approach to lifelog retrieval using virtual reality. The focus of this research is to identify what aspects of lifelog retrieval can be effectively translated from a conventional to a virtual environment and if it provides any benefit to the user. The most widely available lifelog datasets for research are primarily image-based and focus on continuous capture from a first-person perspective. These large image corpora are often enhanced by image processing techniques and various other metadata. Despite the rapidly maturing nature of virtual reality as a platform, there has been very little investigation into user interaction within the context of lifelogging. The experiment outlined in this work seeks to evaluate four different virtual reality user interaction approaches to lifelog retrieval. The prototype system used in this experiment also competed at the Lifelog Search Challenge at ACM ICMR 2018 where it ranked first place

The Físchlár-News-Stories system: personalised access to an archive of TV news

The “Físchlár” systems are a family of tools for capturing, analysis, indexing, browsing, searching and summarisation of digital video information. Físchlár-News-Stories, described in this paper, is one of those systems, and provides access to a growing archive of broadcast TV news. Físchlár-News-Stories has several notable features including the fact that it automatically records TV news and segments a broadcast news program into stories, eliminating advertisements and credits at the start/end of the broadcast. Físchlár-News-Stories supports access to individual stories via calendar lookup, text search through closed captions, automatically-generated links between related stories, and personalised access using a personalisation and recommender system based on collaborative filtering. Access to individual news stories is supported either by browsing keyframes with synchronised closed captions, or by playback of the recorded video. One strength of the Físchlár-News-Stories system is that it is actually used, in practice, daily, to access news. Several aspects of the Físchlár systems have been published before, bit in this paper we give a summary of the Físchlár-News-Stories system in operation by following a scenario in which it is used and also outlining how the underlying system realises the functions it offers

Lifelogging user study:bystander privacy

Automatically and passively taking pictures (using lifelogging devices such as wearable cameras) of people who don’t know they’re having their picture taken raises a number of privacy concerns (from a bystander’s perspective). We conducted a study focussing on the bystanders’ concerns to the presence of augmented reality wearable devices in two contexts (one formal and one informal). The results suggests the need to embed privacy enhancing techniques into the design of lifelogging applications, which are likely to depend upon an array of factors, but not limited to the context of use, scenario (and surroundings), and content

Statistical models for assessing agreement in method comparison studies with replicate measurements

Abstract Method comparison studies are usually analyzed by computing limits of agreement. It is recommended that replicate measurements be taken by each method, but the resulting data are more cumbersome to analyze. We discuss the statistical model underlying the classical limits of agreement and extend it to the case with replicate measurements. As the required code to fit the models is non-trivial, we provide example computer code to fit the models, and show how to use the output to derive measures of repeatability and limits of agreement. KEYWORDS: method comparison, Bland-Altman plot, mixed models * We are grateful to Peter Dalgaard for (much needed) advice on the lme syntax

Are Australian immigrants at a risk of being physically inactive?

Background - We examined whether physical activity risk differed between migrant sub-groups and the Australian-born population. Methods - Data were drawn from the Australian National Health Survey (2001) and each resident's country of birth was classified into one of 13 regions. Data were gathered on each resident's physical activity level in the fortnight preceding the survey. Multivariable logistic regression, adjusted for potential confounders examined the risk of physical inactivity of participants from each of the 13 regions compared to the Australian-born population. Results - There was a greater prevalence of physical inactivity for female immigrants from most regions compared to male immigrants from a like region. Immigrants from South East Asia (OR 2.04 % 95% CI 1.63, 2.56), Other Asia (OR 1.53 95% CI 1.10, 2.13), Other Oceania (1.81 95% CI 1.11, 2.95), the Middle East (OR 1.42 95% CI 0.97, 2.06), and Southern & Eastern Europe are at a significantly higher risk of being physically inactive compared to those born in Australian. In contrast, immigrants from New Zealand (OR 0.77 95% CI 0.62, 0.94), and the UK & Ireland (OR 0.82 95% CI 0.73, 0.92), are at a significantly lower risk of being physically inactive compared to the Australian born population. Conclusion - Future research identifying potential barriers and facilitators to participation in physical activity will inform culturally sensitive physical activity programs that aim to encourage members of specific regional ethnic sub-groups to undertake physical activit

Advances in lifelog data organisation and retrieval at the NTCIR-14 Lifelog-3 task

Lifelogging refers to the process of digitally capturing a continuous and detailed trace of life activities in a passive manner. In order to assist the research community to make progress in the organisation and retrieval of data from lifelog archives, a lifelog task was organised at NTCIR since edition 12. Lifelog-3 was the third running of the lifelog task (at NTCIR-14) and the Lifelog-3 task explored three different lifelog data access related challenges, the search challenge, the annotation challenge and the insights challenge. In this paper we review the dataset created for this activity, activities of participating teams who took part in these challenges and we highlight learnings for the community from the NTCIR-Lifelog challenges

Serious Games Application for Memory Training Using Egocentric Images

Mild cognitive impairment is the early stage of several neurodegenerative diseases, such as Alzheimer's. In this work, we address the use of lifelogging as a tool to obtain pictures from a patient's daily life from an egocentric point of view. We propose to use them in combination with serious games as a way to provide a non-pharmacological treatment to improve their quality of life. To do so, we introduce a novel computer vision technique that classifies rich and non rich egocentric images and uses them in serious games. We present results over a dataset composed by 10,997 images, recorded by 7 different users, achieving 79% of F1-score. Our model presents the first method used for automatic egocentric images selection applicable to serious games.Comment: 11 page